Bayesian meta-analysis for evaluating treatment effectiveness in biomarker subgroups using trials of mixed patient populations.

During drug development, evidence can emerge to suggest a treatment is more effective in a specific patient subgroup. Whilst early trials may be conducted in biomarker-mixed populations, later trials are more likely to enroll biomarker-positive patients alone, thus leading to trials of the same treatment investigated in different populations. When conducting a meta-analysis, a conservative approach would be to combine only trials conducted in the biomarker-positive subgroup. However, this discards potentially useful information on treatment effects in the biomarker-positive subgroup concealed within observed treatment effects in biomarker-mixed populations. We extend standard random-effects meta-analysis to combine treatment effects obtained from trials with different populations to estimate pooled treatment effects in a biomarker subgroup of interest. The model assumes a systematic difference in treatment effects between biomarker-positive and biomarker-negative subgroups, which is estimated from trials which report either or both treatment effects. The systematic difference and proportion of biomarker-negative patients in biomarker-mixed studies are used to interpolate treatment effects in the biomarker-positive subgroup from observed treatment effects in the biomarker-mixed population. The developed methods are applied to an illustrative example in metastatic colorectal cancer and evaluated in a simulation study. In the example, the developed method improved precision of the pooled treatment effect estimate compared with standard random-effects meta-analysis of trials investigating only biomarker-positive patients. The simulation study confirmed that when the systematic difference in treatment effects between biomarker subgroups is not very large, the developed method can improve precision of estimation of pooled treatment effects while maintaining low bias.

Individual participant data from digital sources informed and improved precision in the evaluation of predictive biomarkers in Bayesian network meta-analysis.

OBJECTIVES: We aimed to develop a network meta-analytic model for the evaluation of treatment effectiveness within predictive biomarker subgroups, by combining evidence from individual participant data (IPD) from digital sources (in the absence of randomized controlled trials) and aggregate data (AD). STUDY DESIGN AND SETTING: A Bayesian framework was developed for modeling time-to-event data to evaluate predictive biomarkers. IPD were sourced from electronic health records, using a target trial emulation approach, or digitized Kaplan-Meier curves. The model is illustrated using two examples: breast cancer with a hormone receptor biomarker, and metastatic colorectal cancer with the Kirsten Rat Sarcoma (KRAS) biomarker. RESULTS: The model allowed for the estimation of treatment effects in two subgroups of patients defined by their biomarker status. Effectiveness of taxanes did not differ in hormone receptor positive and negative breast cancer patients. Epidermal growth factor receptor inhibitors were more effective than chemotherapy in KRAS wild type colorectal cancer patients but not in patients with KRAS mutant status. Use of IPD reduced uncertainty of the subgroup-specific treatment effect estimates by up to 49%. CONCLUSION: Utilization of IPD allowed for more detailed evaluation of predictive biomarkers and cancer therapies and improved precision of the estimates compared to use of AD alone.

Using Bayesian Evidence Synthesis Methods to Incorporate Real-World Evidence in Surrogate Endpoint Evaluation.

OBJECTIVE: Traditionally, validation of surrogate endpoints has been carried out using randomized controlled trial (RCT) data. However, RCT data may be too limited to validate surrogate endpoints. In this article, we sought to improve the validation of surrogate endpoints with the inclusion of real-world evidence (RWE). METHODS: We use data from comparative RWE (cRWE) and single-arm RWE (sRWE) to supplement RCT evidence for the evaluation of progression-free survival (PFS) as a surrogate endpoint to overall survival (OS) in metastatic colorectal cancer (mCRC). Treatment effect estimates from RCTs, cRWE, and matched sRWE, comparing antiangiogenic treatments with chemotherapy, were used to inform surrogacy patterns and predictions of the treatment effect on OS from the treatment effect on PFS. RESULTS: Seven RCTs, 4 cRWE studies, and 2 matched sRWE studies were identified. The addition of RWE to RCTs reduced the uncertainty around the estimates of the parameters for the surrogate relationship. The addition of RWE to RCTs also improved the accuracy and precision of predictions of the treatment effect on OS obtained using data on the observed effect on PFS. CONCLUSION: The addition of RWE to RCT data improved the precision of the parameters describing the surrogate relationship between treatment effects on PFS and OS and the predicted clinical benefit of antiangiogenic therapies in mCRC. HIGHLIGHTS: Regulatory agencies increasingly rely on surrogate endpoints when making licensing decisions, and for the decisions to be robust, surrogate endpoints need to be validated. In the era of precision medicine, when surrogacy patterns may depend on the drug's mechanism of action and trials of targeted therapies may be small, data from randomized controlled trials may be limited.Real-world evidence (RWE) is increasingly used at different stages of the drug development process. When used to enhance the evidence base for surrogate endpoint evaluation, RWE can improve inferences about the strength of surrogate relationships and the precision of predicted treatment effect on the final clinical outcome based on the observed effect on the surrogate endpoint in a new trial.Careful selection of RWE is needed to reduce risk of bias.

The Validity of Surrogate Endpoints in Sub Groups of Metastatic Colorectal Cancer Patients Defined by Treatment Class and KRAS Status.

Background and Aim: Findings from the literature suggest that the validity of surrogate endpoints in metastatic colorectal cancer (mCRC) may depend on a treatments' mechanism of action. We explore this and the impact of Kirsten rat sarcoma (KRAS) status on surrogacy patterns in mCRC. Methods: A systematic review was undertaken to identify randomized controlled trials (RCTs) for pharmacological therapies in mCRC. Bayesian meta-analytic methods for surrogate endpoint evaluation were used to evaluate surrogate relationships across all RCTs, by KRAS status and treatment class. Surrogate endpoints explored were progression free survival (PFS) as a surrogate endpoint for overall survival (OS), and tumour response (TR) as a surrogate for PFS and OS. Results: 66 RCTs were identified from the systematic review. PFS showed a strong surrogate relationship with OS across all data and in subgroups by KRAS status. The relationship appeared stronger within individual treatment classes compared to the overall analysis. The TR-PFS and TR-OS relationships were found to be weak overall but stronger within the Epidermal Growth Factor Receptor + Chemotherapy (EGFR + Chemo) treatment class; both overall and in the wild type (WT) patients for TR-PFS, but not in patients with the mutant (MT) KRAS status where data were limited. Conclusions: PFS appeared to be a good surrogate endpoint for OS. TR showed a moderate surrogate relationship with PFS and OS for the EGFR + Chemo treatment class. There was some evidence of impact of the mechanism of action on the strength of the surrogacy patterns in mCRC, but little evidence of the impact of KRAS status on the validity of surrogate endpoints.

Bayesian network meta-analysis methods for combining individual participant data and aggregate data from single arm trials and randomised controlled trials.

BACKGROUND: Increasingly in network meta-analysis (NMA), there is a need to incorporate non-randomised evidence to estimate relative treatment effects, and in particular in cases with limited randomised evidence, sometimes resulting in disconnected networks of treatments. When combining different sources of data, complex NMA methods are required to address issues associated with participant selection bias, incorporating single-arm trials (SATs), and synthesising a mixture of individual participant data (IPD) and aggregate data (AD). We develop NMA methods which synthesise data from SATs and randomised controlled trials (RCTs), using a mixture of IPD and AD, for a dichotomous outcome. METHODS: We propose methods under both contrast-based (CB) and arm-based (AB) parametrisations, and extend the methods to allow for both within- and across-trial adjustments for covariate effects. To illustrate the methods, we use an applied example investigating the effectiveness of biologic disease-modifying anti-rheumatic drugs for rheumatoid arthritis (RA). We applied the methods to a dataset obtained from a literature review consisting of 14 RCTs and an artificial dataset consisting of IPD from two SATs and AD from 12 RCTs, where the artificial dataset was created by removing the control arms from the only two trials assessing tocilizumab in the original dataset. RESULTS: Without adjustment for covariates, the CB method with independent baseline response parameters (CBunadjInd) underestimated the effectiveness of tocilizumab when applied to the artificial dataset compared to the original dataset, albeit with significant overlap in posterior distributions for treatment effect parameters. The CB method with exchangeable baseline response parameters produced effectiveness estimates in agreement with CBunadjInd, when the predicted baseline response estimates were similar to the observed baseline response. After adjustment for RA duration, there was a reduction in across-trial heterogeneity in baseline response but little change in treatment effect estimates. CONCLUSIONS: Our findings suggest incorporating SATs in NMA may be useful in some situations where a treatment is disconnected from a network of comparator treatments, due to a lack of comparative evidence, to estimate relative treatment effects. The reliability of effect estimates based on data from SATs may depend on adjustment for covariate effects, although further research is required to understand this in more detail.

Bridging disconnected networks of first and second lines of biologic therapies in rheumatoid arthritis with registry data: bayesian evidence synthesis with target trial emulation.

OBJECTIVES: We aim to use real-world data in evidence synthesis to optimize an evidence base for the effectiveness of biologic therapies in rheumatoid arthritis to allow for evidence on first-line therapies to inform second-line effectiveness estimates. STUDY DESIGN AND SETTING: We use data from the British Society for Rheumatology Biologics Register for Rheumatoid Arthritis to supplement randomized controlled trials evidence obtained from the literature, by emulating target trials of treatment sequences to estimate treatment effects in each line of therapy. Treatment effects estimates from the target trials inform a bivariate network meta-analysis (NMA) of first-line and second-line treatments. RESULTS: Summary data were obtained from 21 trials of biologic therapies including two for second-line treatment and results from six emulated target trials of both treatment lines. Bivariate NMA resulted in a decrease in uncertainty around the effectiveness estimates of the second-line therapies, when compared to the results of univariate NMA, and allowed for predictions of treatment effects not evaluated in second-line randomized controlled trials. CONCLUSION: Bivariate NMA provides effectiveness estimates for all treatments in first and second line, including predicted effects in second line where these estimates did not exist in the data. This novel methodology may have further applications; for example, for bridging networks of trials in children and adults.